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Amendments to the Claims 

1 I . (can ently amejided) A method for detecting highlights ft'om videos, 

2 comprising: 



3 extracting audio features from the xideo; 

4 classifying the audio featuies as labels; 

5 extracting visual features from the video; 

6 classifying the \nsiial features as labels; and 

7 fusing, probabilistically, the audio labels and visual labels into a 



8 single discrete-observation coupled hidden Markov model to detect 

9 highlights in the video. 

1 2. (cun ently amended) The method of claim 1 , in which the video is 

2 compressed, and the single discrete-obsen'ation coopled hidden Markov 

3 model includes the audio features, the visual feature s. m6io s tates of the 

4 andio features and visual states of the visual features. 

1 3. (original) The method of claim 1 ^ in which silent features are classified 

2 according to audio energy and zero cross rate. 

1 4 . (original) The method of claim 1, in which the audio features are Mel- 

2 scale frequency cepstnmi coefficients. 

1 5. (original) The method of claim 1 , in which the audio features are MPEG-7 

2 descriptors. 
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1 6. (origiiiai) The method of claim I . in which the audio features are 

2 classified using Gaussian mixture models. 

1 7. (original) The method of claim 1 , in which the aiKiio labels are selected 

2 from the group consisting of applause, cheering, ball hit, uiLisic, male 

3 speech, female speech, and speech with music. 

1 8. (original) The method of claim I, in which tJie visual features are based 

2 on miotion activity descriptors. 

1 9. (originai) The method of claim 1 , in which the visual featu.res include 

2 dominant color and motion vectors. 

1 10. (original) The method of claim 1 , in which a variance of the motion 

2 activity is quantized to obtain the visual labels. 

1 1 1 . (original) The method of claim 1 , in which the motion activity is 

2 averaged to obtain the x-isual labels. 

1 12. (original) The method of claim 1, in which the visual labels are selected 

2 from the group consisting of close shot, replay, and zoom. 

13. (canceled) 
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.1 .14. (cuiTently ainended) Hie method of e l aim - l - S claim .1, in whicli the 

2 discrete-observaticm coupled hidden Markov model includes audio hidden 

3 Markov models and visual hidden Maikov oxodels. 

1 15. (original) The method of claim 1 4., in which the discrete-observation 

2 coupled hidden Markov model is generated from a Cartesian product of 

3 states of the audio hidden Markov models and the visual hidden Markov 

4 models, and a Cartesian product of obsei-vations of the audio hidden Markov 

5 models and the visual hidden Markov models. 

1 1 6 . (currently amended) Tlie method of e l aim - 4 - 3 claim 1, further 

2 comprising: 

3 training the discrete-observation coupled hidden Markov model with 

4 hand labeled x-ideos. 

1 1 7, (originai) The method of claim 1 , in which the video is a sport video. 

1 18. (original) The metiiod of claim 1 , further comprising: 

2 determining likelihoods for the highlights; and 

3 thresholding the highlights. 

1 19. (cun entiy amended) The method of claim 2, in which transitions 

2 between the audio states md the visual st ates of the single discrete- 

3 observation coupled hidden Markov model are represented by transition 

4 matrices portion of the video is compressed . 
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1 20. (cmTently amended) Hie method of claim i , in which the probabilistic 

2 fasioii is according to a fipictioii fiisiQii fanction F(Fa, where are the 

3 audio feat ares and f};- are the visual featui es - visHal - ; paFtitiH- ef the - ¥ide<^^ 

4 c - 0m|»F0S6@d . 

1 2 J . (new) The method of clai m 19, in which the transition matrices have a 

2 form: 

4 where 5^ represents the audio states and the visual states, and Pr is a 

5 probability of transitioning to a next state k at the next time instant t given 

6 two current hidden states / and i, respectively, and.A/is anmnber of audio 

7 states and N a niunber of visxial states. 
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